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Abstract. - The amount of work that is needed to change the state of a system in contact with 
a heat bath between specified initial and final nonequilibnum states is at least equal to the corre- 
sponding equilibrium free energy difference plus (resp. minus) temperature times the information 
of the final (resp. the initial) state relative to the corresponding equilibrium distributions. 



Introduction. — Szilard was the first to realize that 
information processing, being a physical activity, has to 
obey the laws of thermodynamics jj. In particular, he 
showed that the entropic cost for processing one bit of 
information is at least fcln2. The correct interpretation 
of this statement turns out to be rather subtle and the 
details (cost of measurement, of information storage and 
erasure, and of reversible and irreversible computation) 
have been the object of a longstanding and ongoing de- 
bate [2HS]. At the time of Szilard the transformation of 
information into work or vice- versa was a purely academic 
question. With the advent of high performance numerical 
simulations and the stunning developments in nano- and 
bio-technology, the issue has received renewed attention 
[BHllj. In particular, information to work transformation 
has been documented in computer simulations [121 and 
has been realized in several experiments [Tl lTSUIB] . Fur- 
thermore, spectacular developments in statistical mechan- 
ics and thermodynamics, including the work and fluctua- 
tion theorems and the formulation of thermody- 
namics for single trajectories instead of ensemble averages 
[24H26] . are very relevant in the context of information 
processing [T2 1 I27H3T ] . 

The second law of thermodynamics in the original for- 
mulation of macroscopic thermodynamics stipulates that 
the amount of work W, required to change the state of a 
system in contact with a heat bath between two different 
equilibrium states, is at least equal to the corresponding 
increase in equilibrium free energy AF'^'^: 



The equality sign is reached for a reversible transformation 
(the system remains at equilibrium all along the transfor- 
mation). Note that W refers to the work performed on 
the system. In particular, work can be derived (W < 0) 
only if the free energy of the system decreases. 

In this paper we give a straightforward and rather gen- 
eral thermodynamic proof, underpinned by exact argu- 
ments from statistical mechanics, that for an initial and 
final condition with distribution p{0) and p(t) different 
from the corresponding equilibrium distributions p°'^{0) 
and p°'^(t), an extra amount of work can be extracted or 
needs to be dispensed, namely: 

Wi„ = W - AF'^'i > TAI. (2) 

Here Wirr is the so-called irreversible work and AI = 
I{t) - /(O) with 



/ = D[p\\p'"^] = Tiphip - Trplnp'^^ > 



(3) 



W - AF^^i > 0. 



(1) 



the relative entropy between the nonequilibrium and equi- 
librium distributions p and p"^, respectively [32l|33]. / 
can also be identified as the amount of information that 
needs to be processed to switch from the known equilib- 
rium distribution p'^'^ to the distribution p under consid- 
eration [35]. While this result has been recently derived 
for open Hamiltonian systems in [34l|35], we demonstrate 
in the present letter its greater generality by obtaining 
it from the nonequilibrium version of the second law of 
thermodynamics combined with the nonequilibrium Lan- 
dauer principle. Furthermore, these results will be proven 
explicitly in the subsequent sections for stochastic Marko- 
vian dynamics, for isolated driven systems and for open 
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driven systems. We are using a quantum mechanical no- 
tation (with p representing a density matrix and Tr the 
trace), but the same result applies to classical systems 
(where p stands for the probability density in state space 
and Tr the integral over state space). 

Second law and Landauer principle. We con- 
sider a system described by a time-dependent Hamiltonian 
H{t). As is usual in statistical mechanics, we characterize 
its state by a density matrix p[t). The system energy is 
the expectation value of the system Hamiltonian Hit): 

E{t) = Tvp{t)H{t). (4) 

We also introduce as nonequilibrium system entropy, the 
von Neumann (or Shannon) entropy: 

5(i) = -Trp(i)lnp(i), (5) 

and the corresponding nonequilibrium system free energy: 

Fit) = E{t) - TSit). (6) 

Here T is the temperature of an ideal heat bath with 
which the system is in contact. Furthermore the latter can 
exchange work with an ideal (i.e., non-dissipative) work 
source. Let us call W{t) and Q{t) the work performed on 
the system and the heat coming from the ideal heat bath 
after a time interval t. Following conservation of energy 
(first law of thermodynamics) the corresponding energy 
change AE{t) of the system is given by: 

AE{t) = W{t) + Q{t). (7) 

For the specific case of a reversible process, the system is 
at equilibrium with the bath at all times and hence is char- 
acterized by the "instantaneous" equilibrium distribution 
p'^'^it), namely the canonical distribution corresponding to 
the "instantaneous" Hamiltonian H{t): 

p'^\t)^e^^{-p{H{t)-F^'^{t))}. (8) 

By setting p{t) = p'=i(i) in (gl) , jS]) and jSl), we obtain 
the corresponding equilibrium values for energy, E°^{t), 
entropy S'^'^{t), and free energy F°'^{t). 

We now state the two major results of this paper. 

Nonequilibrium second law: The change in the nonequi- 
librium system entropy AS" consist of a reversible contri- 
bution due to the heat flow and called entropy flow AcS, 
and of an irreversible (non-negative) contribution called 
entropy production AiS: 

AS{t) = AiS{t) + A^S (9) 
AiS{t) > , Ae5 = Q/T 

An equivalent formulation of the nonequilibrium second 
law can be readily obtained by combining the first law ([7]) 
with the change in nonequilibrium free energy 

TAiS{t) = W{t) - AF{t) > 0. (10) 




Q(t) 



Fig. 1: Schematic ilhistration of equation H12|l . 



In other words, the work that can be derived, —W, is at 
most equal to the decrease in nonequilibrium free energy 
-AF. 

Nonequilibrium Landauer principle: The free energy of 
a nonequilibrium state is higher than that of the corre- 
sponding equilibrium state by an amount equal to the 
temperature times the information / needed to specify the 
nonequilibrium state: 

F{t) - F'^^it) - TI{t) ^ TD[p{tW^it)] > 0. (11) 

Combination of the above results allows to rewrite the 
second law under the form of the nonequilibrium Landauer 
principle 

VFto(t) = W{t)~ AF°^(t) 

= TAiS{t) + TAI{t) (12) 

which leads to the result Eq.([2]) in the introduction. 
Hence, contrary to the case of transitions between equi- 
librium states where AI{t) = and thus Wirr(i) > 0, the 
irreversible work can become negative if the reduction of 
the information AI{t) < is greater than the change in 
entropy production A-^S > 0. 

The proof of (|lip is immediate, since D > 0. The 
derivation of the nonequilibrium second law (|10p will be 
given for three representative scenarios in the next section. 

We first proceed with a further discussion of the above 
results. 

1) Onsager, Prigogine, and others realized that the sec- 
ond law can be formulated for systems evolving in a state 
of local equilibrium. Entropy is then defined as a local 
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quantity obeying a usual balance equation with dcS rep- 
resenting the entropy flow and diS the irreversible local 
entropy production. The second law becomes a statement 
that can be applied locally in space and time diS/dt > 
|36[l37j . The nonequilibrium second law ([S]) is a far from 
equilibrium generalization of this result. 

2) For an ideal reservoir which only exchanges entropy 
but does not irreversibly produce it, the change in the 
reservoir entropy is minus the entropy flow 

AS'r(t) = -Q{t)/T = -Ae5(t) (13) 

As a result, the irreversible entropy production can be 
understood as the "total" entropy change, AS'tot, i-e. the 
change in the system plus reservoir: 

\Sit) = A^tot = AS{t) + ASrit) > 0. (14) 

3) The optimal scenario with respect to work generation 
corresponds to a minimal most negative irreversible work 
W-;^^"", namely 

W^„{t) > W^'^it) = ~TD[pm\p^^{0)] (15) 

To reach this lower bound, two conditions need to be si- 
multaneously satisfied. First, no information has to be 
left in the final distribution (/(<) = 0), i.e., the final state 
of the system corresponds to equilibrium. Second, the 
transformation has to be done reversibly AiS{t) = 0. The 
lower bound can be reached by the following procedure 
(see also [34l|35]). First perform a sudden quench at the 
initial time from the old Hamiltonian H{0) to a new one 
H*(0), such that the original nonequilibrium initial con- 
dition becomes canonical equilibrium with respect to the 
new Hamiltonian (at the same temperature as the bath), 
p(0) = exp{-/3[i?*(0) - F°q'*(0)]} = /9''i'*(0). This is 
obviously a theoretical construction, serving as a proof 
of principle rather than as a practical prescription. One 
may need a (infinitely) large number of parameters con- 
trolling the location of the individual energy levels. The 
quench process does not change the entropy (since the 
distribution is not changed), but will require an aver- 
age amount of irreversible work equal to Wirr (quench) = 
Tr{p(0)[7f*(0) - H{0)]} - {i^'=i^*(0) - F^^O)} = -T/(0). 
Next, starting from this new equilibrium state at time 
0, the final equilibrium state at time t can be reached 
by a quasi-static change of the Hamiltonian - suppos- 
ing t is large enough to permit this - to its desired final 
form. The corresponding irreversible work as well as the 
entropy production vanish. The net result will be that 
Wi„.(t) = VF'i?^/"(0 = -T/(0). 

4) We present a simple explicit illustration of how the 
lower bound W™™{t) can be reached. Consider an N- 
particle ideal gas enclosed in a box of volume V, in contact 
with a heat bath at temperature T. We initially confine 
the gas to the left volume V/2 and let it reach thermal 
equilibrium. At time t — 0, the wall is removed and the 
former equilibrium state becomes a nonequilibrium initial 



condition p(r) (with F the classical coordinates of all gas- 
particles in phase space). It is obviously zero in the right 
half of the volume and is larger in the left half than the 
equilibrium distribution in the full volume p°^{T), by a 
factor 2^. Hence the relative entropy is given by (using 
the physically relevant limit x In a; ^ for a; — !■ 0) : 

/(o) = y'drp(r)in(p(F)//nr)) 

= y"drp(r)ln(2^) =iVln2. (16) 

If the gas is left to expand freely into the entire box until 
it reaches equilibrium, no work is extracted and the in- 
formation stored in T/(0) is completely lost into entropy 
production AiS{t) — /(O). However, if the wall is instan- 
taneously reintroduced and the gas isothermally and re- 
versibly expands against it, T/(0) is completely converted 
into the extracted work —W = Jy^^ dVP — NT In 2 (since 
P = TN/V). We note that work and irreversible work are 
identical here because AF*"^ = 0. 

5) If the system is assumed to be initially at equilibrium, 
we recover the conclusion of 38 that the irreversible work 
is always positive or zero, 

Wi,,(t) >ri?[p(t)||p<=q(i)] >o (17) 

Our result (jlO[) is more general since both initial and fi- 
nal condition are arbitrary. In particular, the irreversible 
work can be negative (more work than the equilibrium free 
energy difference between the initial and final state can be 
extracted) if the system has been initially prepared in a 
nonequilibrium state. 

6) An obvious and also intriguing procedure to realize 
a distribution p different from p^'i is by measuring the 
state of the system. A perfect measurement would yield a 
delta-function distribution. More realistically, one expects 

- due to the measurement error or quantum uncertainty 

- typically a broadened distribution around a most prob- 
able state. According to ([2|), we are then able to extract 
an additional amount of work TI (which could be quite 
substantial as the measurement becomes more precise). 
Alternatively, one can say that the measurement has de- 
creased the total entropy by /. The resulting apparent 
violation of the second law is an example of the Szilard 
information-to-work conversion. In fact, the processing of 
the information / by a physical device will at least off- 
set the gain of work or decrease of total entropy that was 
realized in the measurement. Without entering in further 
details, we cite two recent works in which this information- 
to-work conversion is illustrated, namely one dealing with 
the case of a Brownian particle in a manipulated potential 
[39] and the other with a Hamiltonian particle [40]. Note 
also that a related result was derived in a different context 
(quantum system subject to feedback control) in [TOH^ . 
and verified for the rectification of a Brownian particle 
moving in a staircase potential [13] (see also [45]). 
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7) In the case of a small system, one can raise the ques- 
tion of the role of the interaction energy Any 
entropy production or energetic contribution pertaining 
to the interaction needs to be counted as part of the sys- 
tem energy, see also the discussion for open systems given 
below. 

Stochastic system. — We first derive the second 
law in the context of stochastic thermodynamics [48H5T] . 
which is applicable to both classical (Langevin or Mas- 
ter equation) or semi-classical systems (quantum Master 
equation). This procedure also provides a detailed and ex- 
plicit expression for the various thermodynamic quantities 
involved. Let pi(t) be the probability to find the system in 
state i with energy Hi{t) at time t. We assume a Marko- 
vian dynamics so that its time evolution is governed by 
the following Master equation: 

p,it) = J2^hAt)Piit)- (18) 

j 

Mij is the transition rate matrix, with Mij{t) — 0. 
The time dependence of the states energy Hi{t) is a re- 
sult of the interaction with the external work source. The 
basic physical ingredient for stochastic thermodynamics is 
the requirement that the rates reproduce the proper equi- 
librium state and satisfy local detailed balance. For the 
simplest case considered here (heat exchange with a single 
bath), one has: 

Here we have assumed that the instantaneous stationary 
solution of the master equation (i.e., the eigenvector with 
zero eigenvalue of W{t)) corresponds to the instantaneous 
canonical equilibrium probability ([8]), which is reached 
when the time-dependence is frozen. It is now straight- 
forward to explicitly verify that the first law Q as well 
as the nonequilibrium version of the second law of ther- 
modynamics ([TU)) hold true (for details see e.g. 33]). The 
energy and entropy are respectively given by 

= , S{t) - - ^p,(i)lnp,(t), (20) 

i i 

heat and work by 

Q{t) = , w{t) = ^pKO^.W- (21) 

i i 

The Master equation ([T8| with (|19l) leads to the familiar 
entropy balance equation: 

S{t) = Si{t) + S,{t) (22) 

with entropy flow rate Se{t) ~ f3Q{t) and irreversible en- 
tropy production rate given by: 



There are no assumptions about initial and final states, 
nor on the type of time-dependence of the rates (other 
than the fact that the Markovian approximation and lo- 
cal equilibrium condition remain valid). In fact, not only 
the positivity of the change in entropy production is thus 
proven, but the stronger condition that the rate of entropy 
production is positive. Hence our main result (|12p can be 
replaced by: 

Wi„{t) = Wit) - F<=^(t) = TSiit) + Ti{t) (24) 

Beside reproducing the first and second law, stochastic 
thermodynamics also satisfies the zeroth law: in absence 
of driving (i.e. time-independent energies Hi), the sys- 
tem relaxes to the corresponding equilibrium ([5]). As a 
consequence, for slow changes of the states energies Hi(t) 
(i.e. for reversible transformations), the probability dis- 
tribution is the instantaneous equilibrium probability ([5]) 
which satisfies detailed balance at all times. As expected, 
reversible transformations give rise to zero entropy pro- 
duction (|23l) . Faster transformations will generate posi- 
tive entropy production. Since stochastic thermodynam- 
ics gives explicit expressions for all quantities involved, the 
irreversible work can be calculated for specific models or 
under specific conditions. In particular, the issue of ex- 
tracting maximum work in finite time has been discussed 
in great detail [391I52H56]. 

It is worth noting that for stochastic dynamics, ([T2|) or 
(HH) can be seen as a special case of an even more general 
version of the second law, valid for systems in contact with 
multiple baths, which states that entropy production Si is 
the sum of an adiabatic and a nonadiabatic contribution, 
see eq.(21) of [IS] (see also [1^57^55] ). Indeed, because we 
consider here a single reservoir, the adiabatic contribution 
vanishes and the boundary and the driving term, whose 
sum is the nonadiabatic contribution, see eq.(16) of [48] . 
become respectively — / and WycxIT ■ 

Isolated driven system. — We consider a system, 
described by Hamiltonian dynamics under infiuence of a 
time dependent Hamiltonian Hit), initially in state p(0). 
The Hamiltonian evolution of the system density matrix 
p[t) implies that the von Neumann entropy of the system 
S(t), given by (O, is invariant in time AS{t) = 0. The 
corresponding change in nonequilibrium free energy F = 
E — TS is therefore equal to the energy change AF{t) = 
AE{t). Since there is no heat exchange Q{t) — 0, the 
latter is equal to the work (first law ([7|)), resulting from 
the time dependence of the Hamiltonian: 

W{t) = AE{t) ^ TTp{t)H{t) - Tr/7(0)iJ(0). (25) 

No heat also implies a zero entropy fiow AcS{t) — which, 
using (fTO|). leads to a zero entropy production AiS{t) = 0. 

Consequently, a short calculation shows that the irre- 
versible work, defined relative to an ideal bath at temper- 
ature T, is given by: 

W,,,.it) = A/(t) = TD[pit)\\p^^it)] - TD[piO)\\p'^^m (26) 
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which is the nonequilibrium Landauer principle (jl2p where 
AiS{t) = 0. For equilibrium initial conditions, this re- 
duces to the resuh from [T2 l[30ll38] . 

Wi„{t)=TD[p{t)\\p'''i{t)]>0. (27) 

To provide a meaning to the temperature T in (P^ . we 
connect the system at the final time with the ideal bath. 
The latter will relax from p{t) to p°'^{t) (the zeroth law) 
thus inducing an entropy change AS{t) — S^'^{t) ~ S'(O) 
and an heat flow Q{t) = l\E(t) = E^^t) - E(t). As a 
result the nonequilibrium second law ([9]) becomes 

TAiS{t) = F^^^it) - {E{t) - TS{0)) 

= TD[p{t)\\p^^{t)]>0 (28) 

Using ((26| . this implies that 

Wi„{t) = TA,S{t) - TD[p{0)\\p-^{0)] (29) 

which is the nonequilibrium Landauer principle (jl2[) where 
I{t) = due to the fact that the final state of the system 
is assumed to be at equilibrium p{t) ~ p^^{t). It is inter- 
esting to compare the form of the irreversible work before 
and after the connection with the ideal reservoir, i.e. ((26|) 
with (|29|) . We observe that the information I{t) remaining 
in the final state p{t) (i.e. the part of the initial informa- 
tion 1(0) which has not been converted into work during 
the isolated dynamics) has been converted into entropy 
production (|28)) after the relaxation with the ideal bath 
has occurred. 

Open driven system. — We consider now that the 
system S with Hamiltonian H{t) is open, i.e. coupled to 
a finite bath B with Hamiltonian Hb {t denotes the time 
which varies between and t). The Hamiltonian of the 
total (isolated) system reads 

Htot{T)^H{T)+HB + V{T), (30) 

where V{t) describes the interaction between the system 
and the bath. The system entropy is given by the von 
Neumann entropy ([S]), S{t) = —TTp{t)\np{t), where the 
system density matrix is the reduced density matrix ob- 
tained by tracing the full density matrix over the bath 
degrees of freedom p{t) = Ti BPtot{T)- The work, heat 
and energy are respectively given by 

w{t) = TTptotiT)Htot{T)~TvptomHtom m 

Q(t) = TYptot{0)HB-TYptot{T)HB (32) 
E{t) = Ti:ptot{T)mT)+V{T)] (33) 

We easily verify that these definitions satisfy the first law 
([7])- The nonequilibrium free energy is F{t) — E{t) — 
TS{t). We also note that the interaction term in the total 
Hamiltonian is included in the system energy, while it does 
not enter in the definition of heat. 

In order to make connection with our main results, we 
make the following two assumptions: 



Assumption I: The system and the bath are initially 
uncorrelated. The system in an arbitrary state p{Q) and 
the bath at equilibrium, i.e. 

Ptot(0)=p(0)p^s^. (34) 

It has been shown in [BD] (see also [SI]) that under this 
single assumption, the second law ([9]) or ([T0| is satisfied 
(and positivity is proven): 

A.5W. '^">/^"' .A5(,)-M>a (35) 

Assumption II: At the beginning and at the end of the 
process, the interaction between the system and the bath 
is, respectively, turned on and off, 

V{Q) = V{t) = 0. (36) 

This condition allows the system state functions such as 
energy and free energy to be expressed exclusively in terms 
of system quantities without the contribution from the 
system-bath coupling at the beginning and at the end 
of the process. This assumption is essential to make 
the energy definition (|33p compatible with definition (jlj, 
else they differ by the system-bath coupling. The same 
is therefore automatically true for the free energy which 
means that (jlip is satisfied at final time t and at initial 
time 

F(t) - F'^'^it) = TI{t) = TD[p{t)\\p'"-\t)] > 

F{{)) - F^^Q) = TI{0) EE TD[p(0)||/)'='i(0)] > 0. (37) 

Combining the second law ((35)) [valid thanks to Assump- 
tion I] with (|37|) [valid thanks to Assumption II] , we easily 
recover our central result (|12p : 

Wi„{t) = M/(t) - AF°^(t) 

= TAiS{t) +TAI{t) (38) 

This result is valid for arbitrary coupling strength V{t) 
between time and t. In the weak coupling regime where 
the contributions from the interaction strength can be ne- 
glected, p8p can been derived without assumption II . 

Conclusions. — Our main result (|12p has been de- 
rived for three types of basic dynamics: stochastic dy- 
namics, Hamiltonian dynamics of an isolated driven sys- 
tem and Hamiltonian dynamics of an open driven sys- 
tem. This result shows that the irreversible work consist 
of two contributions: a non-negative entropy production 
contribution and a boundary term containing the informa- 
tion stored in the initial and final condition of the system 
probability distribution. The latter can be negative and 
even lead to negative values for the irreversible work. The 
above result vindicates the view on the second law pio- 
neered by Ilya Prigogine: the entropy production is the 
basic non-negative quantity. 
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